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Abstract: The tree level potential for a scalar multiplet of 'Yukawa fields' Y for one 
type of quarks admits the promising vacuum configuration (Y) oc diag(0, 0, 1) that breaks 
spontaneously SU(3)l x SU(3)r flavour symmetry. We investigate whether the vanishing 
entries could be lifted to nonvanishing values by slightly perturbing the potential, thus 
providing a mechanism to generate the Yukawa hierarchies. For theories where at the lowest 
order the only massless states are Nambu-Goldstone bosons we find, as a general result, 
that the structure of the tree-level vacuum is perturbatively stable against corrections 
from scalar loops or higher dimensional operators. We discuss the reasons for this stability, 
and give an explicit illustration in the case of loop corrections by direct computation of 
the one-loop effective potential of Yukawa fields. Nevertheless, a hierarchical configuration 
(Y) oc diag(e', e, 1) (with e', e <C 1) can be generated by enlarging the scalar Yukawa sector. 
We present a simple model in which spontaneous breaking of the flavour symmetry can 
give rise to the fermion mass hierarchies. 
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1 Introduction 

Fermion family replication represents probably the oldest unexplained puzzle in elemen- 
tary particle physics, dating back to the discovery of the muon by Anderson and Nedder- 
meyer at Caltech in 1936. With the discovery of all the other second and third gener- 
ation particles, the puzzle became even more intriguing because fermions with the same 
SU(3)c x SU(2)l x U(l)y quantum numbers have been found with mass values that span 
up to five orders of magnitude. Explaining such strongly hierarchical mass patterns requires 
a more fundamental theory than the Standard Model (SM), and a plethora of attempts in 
this direction have been tried. In their large majority they basically follow two types of 
approaches: 

(i) The first is to postulate new symmetries under which fermions with the same SM 
quantum numbers transform differently. The fact that fermion families appear to 
replicate is then just an illusory feature of the low energy theory, due to our incomplete 
knowledge of the full set of fundamental quantum numbers. This is, for example, the 
basic ingredient of the popular Froggatt-Nielsen mechanism [1], in which the hierarchy 
of the Yukawa couplings follows from a dimensional hierarchy in the corresponding 
effective Yukawa operators, obtained by assigning to the lighter generations larger 
values of new Abelian charges. 

(ii) A different approach is to assume that the different generations contain exact replica 
of the same set of states. The gauge invariant kinetic terms of each type of fermions 
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of the same charge and chirality is then characterized at the fundamental level by 
a U (3) (flavour) symmetry [2] . This symmetry must be broken: when the breaking 
is explicit and provided simply by the Yukawa terms we have the SM. However, 
interesting theoretical attempts have been put forth in which the symmetry is broken 
spontaneously by vacuum expectation values (vevs) of scalar 'Yukawa' fields, that 
transform under the various U(3) in such a way that, at the Lagrangian level, the 
flavour symmetry is exact [3-13]. 

The first approach basically relies on ad hoc assignments of new quantum numbers in 
order to reproduce qualitatively the observed mass patterns. The other approach, which 
is the one pursued in this paper, can be considered theoretically more ambitious (as it 
relies on less ad hoc assumptions) although it is by far more challenging than the first 
one regarding successful model implementations. In order to offer a natural solution to the 
Yukawa hierarchy, such models should not rely on a hierarchical arrangement of parameters 
or some tuning between them while, e.g., loop-induced hierarchies would be plausible. 

2 Symmetry, invariants, and the tree-level scalar potential 

The SM fermions are arranged into triplets of states with the same gauge quantum numbers, 
and it is then natural to postulate some symmetry group that commutes with the SM gauge 
group and has three-dimensional representations. The symmetry, however, is not realized in 
the spectrum, and generally this signals a non invariant ground state yielding spontaneous 
symmetry breaking (SSB). 

The interesting question is which type of SSB, if any, could split the masses of the 
members of a multiplet and produce the large hierarchies that we observe. A step in this 
direction was taken in ref. [12] and, in order to introduce the theoretical framework and 
notation, we will now recall the main results obtained, following ref. [12] in particular. 

We do not attempt to build a complete flavour model but rather explore the possibilities 
of this kind of approaches. We therefore start simply with a pair of flavour triplets of SM 
fermions with opposite chirality ip % L , i/rL, (i, j = 1, 2, 3) and in representations of the gauge 
group such that their bilinear combination V^V^ can be coupled to the Higgs in a gauge 
invariant way. The largest symmetry of their gauge invariant kinetic term is U x U 
where the first factor acts on the electroweak fermion doublets tpi and the second on the 
weak singlets Here we will concentrate on the semisimple flavour subgroup 



since the fate of the U(l) factors (whether they are broken or contribute to linear combi- 
nations of unbroken generators, as e.g. Baryon number) is of no relevance in what follows. 
We assume that the SM Yukawa term which couples ipL,R to the Higgs field H originates 
from a non-renormalizable effective coupling 



Q F = SU(3) L x SU{3) R 



(2.1) 
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(2.2) 
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that involves a scalar 'Yukawa' field Y (which is, in fact, a matrix in flavour space) and 
some large scale A at which the effective Yukawa operator arises. Invariance of Ly under 
Qf fixes the following quantum number assignments under SU(3)l x SU(3)r: 

^l~(3,1), ^ fl ~(l,3), r~(3,3). (2.3) 

If Y acquires a vev, the flavour group Qf gets spontaneously broken. This of course amounts 
to interpreting the SM explicit breaking as the result of SSB. 

2.1 The T, A, T> invariants 

In the following we will denote by Y a generic background field configuration with compo- 
nents of constant value, although sometimes the spacetime dependence will be indicated 
explicitly, Y(x), to emphasize this is a field (matrix). Configurations that minimize the 
potential will be instead denoted by (Y). To write down the most general renormaliz- 
able ^-invariant potential for Y, and explore its possible ground state configurations and 
properties, let us consider the characteristic equation for the eigenvalues £ of the Hermitian 
matrix YY^ 

V(0 = det (V - YY^ =f- T e + AZ-D 2 = 0, (2.4) 
where I = ^3x3 is the identity matrix in flavour space, and the coefficients are 

T = Tr(YYt) = , (2.5) 



A = Tr 



Adj(YYt)] =J2^j, (2.6) 



D 2 = Det(yyt) = (2.7) 

i 

Being the eigenvalues invariant under group transformations, so are the coefficients of the 
characteristic equation for YY\ namely its trace T (positive definite and of dimension 2), 
the trace of its adjugate (or equivalently of the cofactor) matrix A (positive definite and 
of dimension 4), and its determinant D 2 , which is an invariant of dimension 6. However, 
under special unitary transformations Vl,r of SU(3)l,r (with DetVj,^ = +1) we have for 
the determinant of Y: V = Det(Y) — > Det(V^YV^) = V, so that V is also an invariant, 
but of dimension 3 and thus renormalizable. We conclude that T(x), A(x) and V(x) are 
the renormalizable symmetry invariant field combinations from which the scalar potential 
can be constructed. 

In fact, one can show that the most general SU(3)l x SU(3)r invariant potential 
including nonrenormalizable terms of any dimension, can always be expressed as a function 
of just the three T,A,T> invariants, that is, it has the form V(T, A,D,T>*) + h.c. . This 
amounts to proving that any invariant term of higher order in Y can be reduced to powers of 
T, A, V. For determinants of higher powers of Y we have straightforwardly Det(Y m y!" ra ) = 
D m D* n . For trace invariants let us define: 

T 2n = Tr[(YYt r] j A2n = Tr[Adj(YY"'") n ] . (2.8) 
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According to this notation, T = T2 and A = Ai- It is straightforward to show that 



T 4 = T| - 2 A 2 , A A = A 2 2 - 2 T 2 1? 2 . (2.9) 

To show that higher order invariants T2 n , ^-2n with n > 2 can also be written in terms 
of T 2 , A2, D 2 we can make use of the Cayley-Hamilton theorem, which states that every 
square matrix of complex numbers satisfies its own characteristic equation. That is, by 
substituting £ -)• FF+ in of eq. (2.4), one has the matrix equation: 

V{YY ] ) = {YY ] f - T 2 (YY ] f + A 2 (YY ] ) - D 2 I = . (2.10) 

This allows to rewrite (YY^) 3 , and thus recursively any other higher power of ryt 

m 

terms of the three fundamental invariants and of (YY^) and (YY^) 2 which in turn reduce 
to T2, A2, D 2 after taking the trace or after tracing their adjugates and using eq. (2.9). 

2.2 Scalar potential and tree-level vacua 

A necessary condition to ensure that the observed hierarchy of the SM Yukawa couplings 
is reproduced, is that, at the SSB minimum: 

(D) 1 / 3 < (A) 1 / 4 « (T) 1 / 2 , (2.11) 

where D = \T>\. The first goal is then to construct a scalar potential which naturally has 
such minimum. In terms of the T, A, T> invariants the most general renormalizable potential 
for Y can be written as [12] 1 

V = V t + Va + Vd, (2.12) 



with 



V T = A 



21 2 

m 



(2.13) 



2A 

V A = X A A, (2.14) 
V v = fiV + tfV* = 2/iD cos^p. (2.15) 

We assume that all the Lagrangian parameters are evaluated at the scale A, which can be 
identified with that in eq. (2.2). Vt in eq. (2.13) contains the two renormalizable invariants 
constructed from the trace, Vt = XT 2 — m 2 T, plus an irrelevant constant. We require 
A > and m 2 > in order to have a potential bounded from below and to trigger SSB. 
The parameter A^ which multiplies A can be either positive or negative, and we need to 
consider both possibilities. The last equality in eq. (2.15) is obtained after defining jj, = [ie tS 
with /j,= \fl\, V = e^'^D, and (f>v{x) = f(x) + 6. 

Let us now seek the most general form for the vev of the scalar field. A generic 3x3 
matrix of (complex) constant background fields Y has 9 moduli and 9 phases, and by means 
of an SU (3) l x SU (3)r rotation (corresponding to 3+3 moduli and 5+5 phases) can always 

1 As long as (i/ t ff)/A 2 < 1 the coupling with the Higgs, H^HT, can be omitted from eq. (2.12). 
Regarding the effects of such coupling on the Higgs potential, electroweak symmetry breaking at the correct 
scale would require a certain degree of fine-tuning in the term H ((T) — fljj). 
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be brought into diagonal form = diag(Yii, Y^, ^33)- Since the SU(3)l,r diagonal 
generators A3 and As commute with Y^ d \ this matrix is invariant under the subgroup 
U(l)^\ 3 ) L+R x U(l)(\ s ) L+R and therefore, out of the initial 9 phases, only 10 — 2 = 8 can 
be removed by flavour rotations. Without loss of generality we can then choose a basis in 
which the background classical field has the form 

Y = -J= diagCRn, R22, R33 + ^33) , (2.16) 

where Ru and J a are real scalar fields. 

Regarding the value of Y that minimizes the potential in eq. (2.12), that is, the tree- 
level vev of Y, from eq. (2.15) we immediately see that if (D) ^ then Vjy is minimized 
when cos4>t> = —1 (by (ip) = it — 5), so that we can restrict our analysis to D > in 
what follows. If instead (D) = at the minimum of the potential, the phase of (T>) is 
undetermined (and ip has a flat potential). This allows us to set (if) = ir — 5 and search 
for the minimum around the configuration 

Vv" = Vd = -2/aD, (2.17) 
(Y) = i diagCRu, R 22 , R 33 ) , (2.18) 

where, with a slight abuse of notation, we have denoted with R33 the modulus \/2 \Y3s\ . 
From eq. (2.13) we immediately see that Vr is minimized on the surface (T) = m 2 /(2A) of 
the sphere in the eighteen dimensional parameter space. Note that since we must require 
m 2 /(2A) ^ A 2 in order to explain e.g. the value of the top-quark Yukawa coupling 2 , then 
a perturbative A < 1 implies m 2 < A 2 , consistently with the effective theory treatment. 
Concerning A and D, they are both maximized for symmetric vacua (Y) oc diag(l, 1, 1) 
and their minimum value is zero. To ensure (D) = 0, at least one entry in (Y) must vanish, 
while for (A) = two entries must vanish, e.g. (Y) oc diag(0, 0, 1). Which particular 
minimum on the surface of constant (T) is selected depends on the sign and value of A^ 
and on the value of ^. Following [12] we recall below which types of SSB minima can occur 
and under which conditions. 

(i) When < we have to require \Xa\ < 3 A in order that the potential remains 
bounded from below. A is maximized for symmetric vacua (eq. (2.19) below) and 
since Va = is negative this is the favoured configuration. D is also maximized 
for symmetric vacua so that the negative value of Vx>, eq. (2.17), further lowers the 
minimum. The symmetric vev 

(Y) s = v s dmg(l, 1, 1), (2.19) 

(where v s is given in eq. (18) of [12] with A' = — A^) corresponds, however, to non- 
hierarchical Yukawa couplings yielding (T) ~ (A) 1 / 2 ~ (D) 2 / 3 = v 2 . 

2 For example, at a cutoff scale A ~ (10 9 -10 12 ) GeV we have y t = (Y S3 )/A ~ 0.6-0.5 [14]. In particular, 
this justifies neglecting contributions to the Yukawa terms eq. (2.2) of dimension higher than five. 
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(ii) When Xa > 0, Va = XaA is always positive and minimized for (A) = 0, which favours 
(hierarchical) vacua with two vanishing entries 

(y) /l = ^diag(0, 0, 1). (2.20) 

with Vh = m/v / 2A. Given that V ((Y) h ) = 0, this configuration is selected as long 
as the potential in the symmetric direction has a positive definite value V ((Y) s ) > 
in spite of a possible negative contribution from Vd- This occurs as long as (see [12] 
for details) 



4<2A 



4 + T " 8 + 3 A 



(2.21) 



In this case (T) = vf t while (D) = (A) = 0, which represents a promising first 
approximation to the realistic hierarchy, as in eq. (2.11). 

Thus, the tree level analysis indicates that the most general renormalizable Qf = 
SU(3)l x SU(3)r invariant potential admits two types of SSB vevs, that lead to the two 
symmetry breaking patterns Qf —> H s and Qp — > respectively with little groups: 

H s = SU(3) L+R , (2.22) 
H h = SU(2) L x SU(2) R x U(1) (Xs)l+r . (2.23) 

Before concluding this section let us recall some jargon specific to SSB problems, as 
well as some general results. The largest subgroup H C Qf that leaves invariant some 
background field configuration (Y) is called the little group of (Y). In particular, the 
little groups H s ^ in eqs. (2.22)-(2.23) are maximal little groups in the sense that none is 
contained in the other or in another little group of Qf- Acting with group elements in 
Qf/H on (Y) while keeping its 'length' ((T) in our case) fixed, one obtains the orbit of 
(Y). If in the neighbourhood of (Y) all other background configurations have the same 
little group H, the collection of their orbits is called an open stratum (or dense stratum). 
An example of a configuration with orbit belonging to an open stratum is the general form 
(Y) ~ diag(a, b, c) corresponding to eq. (2.18), with little group 3 

H abc = U(1) [X3)L+R x U(1) (X8)L+R . (2.24) 

The boundaries of an open stratum are the closed strata, which contain orbits in the 
neighborhood of which there are other configurations with different little groups. If H C Qf 
is a maximal little group, then the corresponding (Y) is in a closed stratum. If the closed 
stratum has only one orbit, this orbit is a stationary point of any smooth real invariant 
functions of (Y) (Michel- Radicati theorem [15]). 

In our case, the boundaries of the open stratum of the general background field con- 
figuration in eq. (2.18) are (Y) s,h in eqs. (2.19)-(2.20) and, in agreement with Michel's 
theorem [17], their little groups H s ^ [eqs. (2.22)-(2.23)] are the maximal stability groups of 
the most general fourth order function of the invariants (the tree- level potential) . 



Considering the full initial group of invariance U(3) 2 = U(1) b xU(1) L -rxSU{3) 2 one readily recognizes 
that the full little group of continuous transformations for the Yukawa configuration eq. (2.18) is = U(1)b X 
U(l)(x 3 ) L+R x U(1)(\ S -) L+R which are linear combinations of the three baryon flavour symmetries U(l)Bi 
(eventually broken to U(1)b by inter-generational quark mixing). 
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Figure 1. The orbit space for the group SU (3) i x SU (3)_r broken by a field Y in the bi-fundamental 
representation, plotted in the plane (A/T 2 , D/T 3 / 2 ) with an arbitrary nonzero T. The -ff's labeling 
the points in the plot denote the little groups of the corresponding field configurations (Y) . H aaa = 
H s and -ffoob = Hh are t ne rnaximal little groups of (Y) ~ diag(a, a, a) and (Y) ~ diag(0, 0, &). 

As we have seen, although the potential is a function of many scalar fields (Y has 
18 degrees of freedom) the fact that only the 3 invariants T, A and D enter, simplifies 
greatly the minimization problem. A further simplification follows from the observation 
[16] that the orbit space can be described in a compact way by T (which is nonzero in any 
symmetry breaking vacuum) and by the two dimensionless ratios of invariants r& = A/T 2 
and td = D/T 3 / 2 , which are respectively bounded within the intervals < < 1/3 and 
< rjj < l/(3\/3). For given fixed values of r& and re, the potential is a function of 
T only, with some minima (T)(ta,td)- The global minimum is then the deepest of such 
minima in the whole range (rv^ro). Such an orbit space does not depend on the details 
of the potential, but only on the group structure and on the representation of the scalar 
fields. For our case the orbit space is plotted in figure 1 in which, for instance, H aaa refers 
to the symmetric little group H s = SU(3)l + r and labels the field configuration (Y) ~ 
diag(a,a, a), while a generic point H a bc labels the field configuration (Y) ~ diag(o, b, c). 
For our labels we keep the ordering a < b < c, so that the plot gives also information on 
the relative size of the (Y) entries. Note that the point labeled Hq^ belongs to the same 
stratum as H a bb, while the point i?oa6 belongs to the same stratum as H a b c - Regarding 
H aa b and if a &6, although they label disconnected regions in orbit space, they correspond 
to the same little group, that is SU{2)l + r x U(1)^x s ) l+r , and so they belong to the same 
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stratum. Following the method proposed in ref. [16], the little groups of the global minima 
of Vq can also be determined through an analysis of equipotential lines in the orbit space. 
The result is that for Aa < the minimum of Vq always is at H aaa = (l/3, l/(3\/3)) , while 
for Xa > the minimum can be at -£/oo& = (0) 0) or at H aaa , depending on the values of the 
parameters (i.e. if eq. (2.21) is satisfied or not). This of course coincides with our previous 
findings. 

The question now is if, as suggested by Michel's conjecture [17], the one-loop effective 
potential can only have minima with the same maximal little groups H St h as the tree- 
level potential, or if phenomenologically more appealing minima with the generic little 
group Habc are possible. On one hand, if a phenomenologically acceptable minimum had 
corresponded to a maximal little group, it would have been easy to model a potential leading 
to it, as this is facilitated by the group structure which makes such symmetry breaking 
natural. On the other hand, seeking for a symmetry breaking pattern with non-maximal 
little group is harder but might offer some deeper insight into the dynamics producing 
such breaking. Be that as it may, as we will discuss in the next two sections, although 
counter-examples to Michel's conjecture are known to exist [18], in our case H s h remain 
stable with respect to perturbative effects from loop corrections or from operators of higher 
dimension. 

3 Sequential breaking 

The symmetric solution (Y) s = u s diag(l, 1, 1) in eq. (2.19), which yields non-hierarchical 
Yukawa couplings, is phenomenologically uninteresting and we do not consider it (although 
it might be of interest in the neutrino sector). The solution (Y) h = Vh diag(0, 0, 1) in 
eq. (2.20) appears instead as a promising first approximation to the observed Yukawa hier- 
archies, but is tenable only if the two vanishing entries can be lifted to small nonzero values 
by some effect. In this section we want to consider the possibility of obtaining a vacuum 
(Y) = vy diag(e', e, 1) with the non-maximal little group H a t, c C H^, from a small pertur- 
bation of the tree-level vacuum (Y) h in eq. (2.20). Such perturbation could be provided, for 
instance, by one- loop corrections to the effective potential V e g (as hypothesized in ref. [12]) 
or by higher dimensional operators. We will show that in general these possibilities cannot 
be realized. 

Let us focus for the moment on the symmetry breaking pattern Qp — > H^, i.e. the 
minimum is (Y) h = diag(0, 0, 1) with Vh = m/\/2A. There are uq = 8 + 8 generators in 
Gf, and uh = 3 + 3 + 1 = 7 unbroken generators in the little group H^. Nine generators are 
thus broken and accordingly we find in the spectrum nj, = 9 massless Nambu-Goldstone 
Bosons (NGB). The remaining nine states are arranged in multiplets of Hh with masses: 

mf = 4At>^ , 1 state, (3-1) 

m\ = XavI =t ^ v h , 4 + 4 states. (3-2) 

Assuming that upon minimization of the one-loop effective potential a ground state with 
little group H' C with njji < nn h unbroken and ny > broken generators is ob- 
tained, would then imply that out of the 9 massive states, nn h — njji have to become the 
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new massless NGB. The required cancellation between the tree- level and loop mass con- 
tributions do not conform to the perturbative approach to this problem. In other words, 
the zeroth-order mass relations determined by the unbroken subgroup of the symmetry 
group should persist also at higher orders [19]. More precisely, a theorem proved long 
ago by Georgi and Pais [20] states that a reduction of the tree-level vacuum symmetry 
via radiative corrections can only occur if there are additional massless bosons in the tree 
approximation. 4 This can be seen in the following way: the Goldstone theorem states that 
for each generator T a of a continuous symmetry acting nontrivially on the vacuum there 
is a massless scalar, that is: 

T a ■ (Y) / => M 2 • T a • (Y) = , (3.3) 

where M 2 is the second derivative of V with respect to the fields evaluated at Y = (Y). 
Following ref. [20], let us now write M 2 = M$ + 5M 2 and (Y) = (Y) + 5(Y) where Mq 
and (Y)o are obtained from minimization of Vq , while 5M 2 and 6(Y) are the perturbations 
induced by higher order corrections to the potential. Stepwise breaking implies that there 
must be some generator T a in the little group H of the tree-level vacuum that is not in 
H', that is: 

T a ■ (Y) = 0, and T a ■ (Y) / . (3.4) 
At first order in the corrections, eq. (3.3) becomes 

M 2 ■ T a ■ (Y) + 5M 2 ■ T a ■ (Y) + M 2 ■ T a ■ 5{Y) = . (3.5) 

The first two terms in this equation vanish because of the first equation in (3.4), and the 
vanishing of the last term then implies additional massless scalars, that at the tree level 
are not NGB. In this further breaking of the symmetry by higher order effects 

can simply transform some of these additional massless states into NGB. A well known 
example is the Coleman- Weinberg (CW) potential [21] in which the scale invariance at the 
tree level implies (non-Goldstone) massless states in the lowest order approximation. The 
breaking of the symmetry at one loop then transforms some massless states into NGB and 
gives mass to the remaining ones. 

A crucial point in our particular case is that the extra massless scalars in the tree 
approximation should appear naturally, e.g. due to some extended accidental symmetry, 
because of some larger symmetry of the tree-level vacuum [22] or due to renormalization 
group evolution of parameters (so that these massless scalars appear at some particular 
renormalization scale). For example, it is technically possible to tune the mass rv?_ in 
eq. (3.2) to zero by setting X^va = fiV2X, and this would result in four additional mass- 
less states at the tree level. To verify if this condition allows for a further breaking of 
the symmetry by loop corrections, we have carried out a numerical minimization of the 
SU(S)l x SU(3)r one-loop effective potential given in the Appendix. In the general case 
with no additional massless states, the parameter space of the effective potential remains 
divided into two regions corresponding to the two vacuum structures (Y) h = Vh diag(0, 0, 1) 

4 Perhaps a bit surprisingly, this applies also to radiative breaking of discrete symmetries like CP [20]. 
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and (Y) s = v s diag(l, 1, 1) with a boundary that is still given with a good approximation 
by condition eq. (2.21). By setting Xaiti = /i\/2A one obtains that this condition is never 
satisfied, the vacuum remains in the symmetric configuration (Y) s with little group H s and 
no further breaking occurs. 

Although there is no natural way to forbid the two terms Va and Vp in the potential, 
additional massless states would be obtained by setting by hand fj, — > and Xa — > 
in the tree-level potential eq. (2.12). This is because the surviving part Vr, eq. (2.13), 
has an accidental symmetry 50(18) that is much larger than SU(3)l x SU(3)r. The 
minimum condition T = ^2A"YY')u = m 2 /(2X) fixes the radius of the eighteen-dimensional 
hypersphere, leaving the vacuum symmetry SO (17) of the hypersurface which is broken 
by a choice of the vacuum direction. We thus obtain seventeen massless bosons: the nine 
NGB of the broken SU(3)l x SU(3)r plus 4 + 4 additional massless states corresponding 
to the eigenvalues in eq. (3.2). Clearly, in this case since the symmetry of the full theory is 
just SU(3)l x SU(3)r of the Yukawa operator eq. (2.2), it is conceivable that corrections 
due to other interactions (as the ones that give rise to the effective Yukawa operator, or 
SU(3)l x SU(3)r gauge interactions if the flavour symmetry is gauged) could eventually 
yield a stepwise breaking. We will discuss further this possibility in the next section. 

In conclusion, lifting the tree-level vev (Y) h = diag(0, 0, 1) to a vev with hierarchical 
components (Y) = vy diag(e', e, 1) would require at least the symmetry reduction SU (2) l x 
SU(2) R x U(l) {Xa)L+R -> U(l) {X:j)L+R x U(l)(x 8 ) L+R - If, as in the case we are considering, 
there are no additional tree- level massless states, the nn h — n H abc = 5 new NGB cannot 
appear at the loop level, and thus no stepwise reduction of the symmetry can occur. We 
will mention in Section 4 possible loopholes to this conclusion. 

Concerning the possibility that corrections from higher dimensional operators [8] could 
provide the sequential symmetry breaking we are looking for, we can again rely on the 
Goldstone theorem to formulate the necessary conditions for this to happen. Including 
higher dimensional terms, we can write the scalar potential as 

%,A) = y ( K ) + ^^O 4+fc , (3.6) 

k 

where Vo(pi) is the tree-level potential, eq. (2.12), which depends on the parameters {pi} = 
{m, /d, A, Xa} and 4+fc represents the set of operators with dimension 4 + k (k> 1) that 
are perturbatively suppressed by powers of the high energy scale A. Eq. (3.5) translates 
straightforwardly into 

M$( Pl )-T a -5(Y) = 0. (3.7) 

where 8{Y) depends on A. Stepwise breaking implies that T a -S(Y) is non vanishing, which 
in turn requires additional non NGB massless states in the tree level mass matrix M^(pi). 
In the absence of these states, we can then conclude that also operators of higher dimension 
are unable to induce perturbatively sequential symmetry breaking. 
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4 Generalization 



We have seen that the maximal little groups H B h of the stationary points of the tree- 
level potential, eq. (2.12), are stable against corrections to the effective potential in- 
duced by loops or higher dimensional operators. Thus, hierarchical minima with the 
observed structure (Y) = uydiag(e', e, 1) cannot simply occur as a perturbation from 
(Y) h = f/jdiag(0, 0, 1). However, ref. [12] found that, if the one-loop potential were to 
have terms like A log A and DlogD, they could produce global minima different from (Y} h 
or (Y) s in eqs. (2.19)-(2.20). Also, a potential that indeed can have a hierarchical minimum 
(Y) = vy diag(e', e, 1) is given in appendix B.2 of ref. [11]. Such examples show that there 
is no group theory obstruction to finding potentials with minima that have little groups 
different from the maximal ones H s ^. 

We will now show that under some general conditions the smallest little group preserved 
by the minima of smooth functions of the SU(3)l X SU(3)r invariants is SU{2)l + r x 
U(V)(\ S ) L+R . This corresponds, in the diagonal basis, to the structure (Y) ~ diag(a,a, b), 
which can only allow for a partial hierarchy. In contrast with the results presented in 
Section 3, the present argument does not rely on perturbative expansions, and can be 
applied to more general classes of effects. 

Let us consider from now on a generic smooth potential function V(T, A, D), where we 
take T> real from the start and, without loss of generality, the invariants are written in the 
real diagonal basis for Y, as in eq. (2.18). The minimization equations are (i = {1,2,3}) 

dV dT dV dA dV 3D 

where, as above, the £j are the eigenvalues of (YY') (i.e. (YY') = diag(£i, £2, £3) in our 
specific basis). We have 

dT _ OA dD _ 1 D 



so that (4.1) leads to the quadratic equation in 



dV 2 
OA ^ 



dV dV m 

1 T 

dT dA 



Thus, at the extremal point, the three £j eigenvalues should be solutions of the same 
equation above which, being quadratic, can only have at most two different roots. It is in 
this sense that we expect generically to have a little group at least as large as SU(2)l + r x 
U(1)(\ 8 } L+R . From this, it follows that regardless of the type of potential function V, the 
only way to obtain three distinct values £1,^2, £3 is to make zero the three coefficients in 
eq. (4.3). In this particular case the minimization equations reduce to: 

dV dV dV 

ST= ' 3A =0 - 8D =0 - (4 ' 4 » 

We could have anticipated this: the secular equation (2.4) gives a univocal correspondence 
(modulo trivial permutations) between its coefficients and its solutions (that are physically 
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acceptable in the real domain). Then, when all three £j's are different, we can use T, A, D 
instead of the & to describe field space, and as we are interested in a fully hierarchical 
pattern of Yukawas, we are precisely in that situation. 5 In all other cases, when one of the 
three equations in (4.4) is not satisfied, the vacuum will have at most the partial hierarchy 
(Y) ~ diag(a,a,6). 

We can now understand from another point of view the negative result found in the 
previous section in our search for a hierarchical minimum by perturbing over the tree-level 
minimum (Y) h = Vh diag(0, 0, 1). Writing the potential as V = Vo + AV, with the tree- 
level potential Vo as in (2.12) and AV representing some small correction, either from loop 
effects or higher order operators, the minimization equations (4.4) become 

2\T -m 2 + — = , 
dAV 

dAV 

"2/^+^ = 0. (4.5) 

Let us write (T) = (T)n + 8{T), where (T)o is the value of T at the tree level minimum 
and 5{T) a shift in this value due to AV, with analogous notations for A and D. The tree 
level minimum corresponding to (Y) h has (T)o 7^ and (A)q = (D)q = 0. Now if one 
tries to analyze by means of equations (4.5) how this minimum can be perturbed by the 
correction AV, the first key observation is that the tree- level minimum does not satisfy 
the tree-level form (i.e. with AV removed) of all these equations, but only the first one, 
with (T) = m 2 /(2A). The shift 5(T) would then be obtained as 



2Ai(T> = mV 



dT 



(4.6) 



with the subscript indicating that the derivative is evaluated at the tree-level minimum. 
However, the two other minimization equations are not consistent unless \x and are 
suppressed to at least the order of the perturbation AV, perhaps being zero. As already 
noticed in section 3, if fi and Xa are in fact zero, there are 17 massless states at tree-level, 
and this clears up the difficulties with Georgi-Pais' theorem [20]. In the diagonal basis, 
the minimum condition reads T = £i + £2 + £3 = m 2 /(2X) which is satisfied by points 
on a hyperspherical surface of equivalent vevs, including hierarchical ones. Which 
vev is eventually selected then would depend on radiative corrections (or on other higher 
order effects). Nevertheless, the one-loop potential does not resolve this degeneracy: when 
/x = = 0, AV is a function of the T invariant only, i.e. no potential for A and D is 
generated at one-loop. This can be checked explicitly using the results presented in the 
Appendix, which calculates the contributions to the potential from scalar self-interactions. 
In principle, interactions of the Yukawa fields with other sectors of the theory could give 



5 In ref. [12], vev structures (Y) = vy diag(e', e, 1) were obtained by minimizing separately two functions 
respectively of D and A, that included their logs, and assuming that the minimum of the two separate 
functions gave the global minimum. That procedure is in fact incorrect. By minimizing numerically the 
full logarithmic potential we have verified that global minima with e — e are obtained. 
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additional contributions that could change this picture. This, however, would require 
introducing a significant model-dependence. 

Let us examine next the structure of a potential tailored to give any desired pattern 
of Ra. Constructing such generic potential is in fact straightforward: 6 

V = A (T - (T)) 2 + ij (A - (A)) 2 + ~{D- {D)f , (4-7) 

where the values of (T), (A), (D) correspond to the chosen values of ^ according to eqs. (2.5)- 
(2.7). Omitting an unimportant constant, we can split V = Vq + AV in the usual renor- 
malizable part 

V = XT 2 - m 2 T + X A A - 2fiD , (4.8) 
plus the correction AV, which contains the following two d = 8 and d = 6 terms: 

AV = ~¥ a2 + • (49) 

For any (finite) cutoff scale A, any chosen vacuum configuration {(T), (A), {D)} can be 
reproduced by choosing the values of the parameters as: 

m 2 = 2X(T), A A = -2^<0, M=^- (4-10) 

For the validity of the effective theory approach, and to reproduce the hierarchical Yukawas, 
the vacuum expectation values should be smaller than the corresponding power of the scale 
A. This means, in particular, that \l and Xa are required to be quite suppressed also in 
this scenario. 7 Such suppression is directly responsible for the Yukawa hierarchy, and this 
does not represent the kind of natural explanation we are looking for. Notice also that, as 
A ,4 < and \i > 0, the minimum of the tree- level potential corresponds to the symmetric 
configuration £i = £2 = £3 so that AV does not represent a small perturbation of the tree 
level vacuum structure. The correction to the potential can have such a large effect only 
because in this scenario the parameters of the tree-level potential are assumed to have 
values much smaller than the size of the corrections. 

In the previous discussions, the scale dependence of the Lagrangian parameters has 
been disregarded, although their RGE running can add new features to the minimiza- 
tion problem. For example, although the functional form of the SM Higgs potential, 
V(h) = —{m 2 /2)h 2 + (Xh/4)h A , allows for only one minimum, its renormalization-improved 
version, with running m 2 and Xh evaluated at a renormalization scale Q ~ h (as neces- 
sary for a faithful description of the potential in a large range of h values) has a richer 
structure. In fact, for low values of the Higgs mass (as the value currently measured at 
the LHC, rrih ~ 126 GeV [24]) a second minimum develops at a scale much larger than 
the electroweak scale, when the quartic Higgs coupling A^ is driven to negative values due 

6 A potential of this form is given in appendix B of [11]. 

7 For example, by adding to Va, eq. (2.14), higher order corrections in the form (\a + (T)/A 2 + (T) 2 /A 4 + 
. . . )A, we would get from the hierarchy condition (T) 2 > (A) and from the second relation in eq. (4.10) 
that the tree level coupling Xa must be smaller than the second order correction ~ (T) 2 /A 4 . 
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to large radiative corrections from the top Yukawa coupling (see ref. [25] for the state- 
of-the-art analysis). For particular values of the Higgs mass, the negative quartic stays 
small enough to cancel against the value of its /3 function, providing a second solution 
to the minimization equation dV/dh ~ [A^ + ( 1 /4) dA^ /a! log /i]/i 3 = 0. We could imagine 
something similar happening with the potential for the Yukawa fields Y: the structure of 
this potential at the renormalization scale relevant for the largest nonzero vev Q 2 ~ £3 
could in principle be different from its structure at the lower scales relevant for the smaller 
vevs £1 and £2- However, the problem is now complicated by the fact that the potential 
is a multifield one and the correct description of a hierarchical vacuum requires the use of 
three different renormalization scales simultaneously (a multiscale problem often faced in 
effective potential studies, see e.g. [23]). We limit ourselves to pointing out this possibility 
as worthy of future exploration. 



5 Symmetry breaking via reducible representations 

The results of the previous sections make clear which way is left open to get a phenomeno- 
logically viable pattern of vevs for the components of the Yukawa field Y. Namely, the 
flavour symmetry must be broken down to H a i, c , eq. (2.24), already at the tree level. For 
this, we need a non-minimal set of scalar fields in reducible representations of the flavour 
group. In fact, breaking a symmetry by means of reducible representations avoids at once 
the issue of maximal stability little groups: even defining what are open strata and closed 
strata is not clear in this case. A minimal enlargement of the scalar sector involves adding 
two multiplets, Zl^r, that transform respectively in the fundamental of one of the two 
group factors SU(3)l x SU(3)r while they are singlets under the other one: 8 



(3,1) 



Zr = (1,3). 



(5.1) 



The most general SU{3)l X SU(3)r invariant potential involving Zl, Zr and Y = (3,3) 
can be written as 

V = V A + V D + V l + V m + V , (5.2) 

with 



Vi = A T 



+ 9 



2 \ 

2a; 

„2\ 



+ A L \Z L 



m, 



2\ L J 



rnr \ g 1L 
2\J g 



Zl\ 



m, 



2A L 



V m = g 2 LZ[YY^Z L + g 2R z\ t Y^YZ_ 
V = DZ\YZ R + h.c, 



+ \r[\Zr\ 



in 



R 



91R 
9 



Zr\ 



m 



2Xr 
2 



R 



2Xr 



(5.3) 

(5.4) 
(5.5) 



8 The vevs of Zl,r represent sources of flavour breaking that do not transform as the SM Yukawa 
couplings, and thus in principle imply a non Minimal Flavour Violating (MFV) [26] scenario. However, 
by a suitable choice of the representations of the messengers that generate the Yukawa operators, one can 
forbid all dangerous FCNC Yukawa-like operators involving Zl,r. 
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while Va and Vp have already been given in eq. (2.14) and eq. (2.15). V\ in eq. (5.3) can 
be equivalently written as 

^-( r -s 2+ ^H 2 -i) 2+ ^H-i) 2 

+ 2T {g XL \Z L \ 2 + g lR \Z R \ 2 ) + 2 |Z L | 2 |Z fi | 2 + const . (5.6) 

9 

This second way of writing V/ makes apparent which relevant terms quadratic and quartic 
in the fields have been included; however, eq. (5.3) is more convenient for minimization, 
since it makes transparent that V\ (which for A, A^, X R ,g > has manifestly its minimum 
when it vanishes) determines the 'lengths' of the three multiplets to be, respectively: 

CO = 4 = ™^ ^l 2 )=^ = ^ (\Zn\ 2 )=v R =™k, (5.7) 

without having other effects on the particular structure and/or alignment of the three vevs. 
Note in particular that eq. (5.3) also makes apparent that the correct tree-level minima 
can already be obtained from the first line alone, that is, by setting giL,gm and g — > (in 
particular, this limit largely simplifies the identification of the Goldstone bosons). 

The role of V m is instead that of misaligning (or aligning) the vevs of Zl,r with the 
vev of Y. Our aim is to enforce a maximum misalignment, in order to obtain the smallest 
possible intersection among the little groups of the vevs of the three multiplets, and this 
is achieved for g2L,92R > 0. Thus we assume that both couplings in V m are positive, 
and we will not analyze other possibilities, since they would only yield phenomenologically 
uninteresting vacuum structures. 

Once the matrix of constant fields Y has been brought to the diagonal and partially 
real form, eq. (2.16), by means of symmetry rotations, we are left with the freedom of 
removing only one phase from Zl and another one from Z R . However, we will now argue 
that, for the minimization problem, we can take Zl,r real. After defining v = \u\, the last 
term Vc can be rewritten as: 



z{yz r 



COS (j) L R- (5.8) 



At fixed values of (Y), (Zl), (Zr) the minimum of Vp occurs when cos^lr = — 1, that is, 
for real and negative values of the vev of the trilinear term (ZjYZr). On the other hand, 
it is easy to verify that the modulus of the trilinear term in eq. (5.8) is extremized for real 
values of the three vevs (Y), (Zl), (Zr). We have already argued that minimization of the 
potential can be carried out by taking Vx> in the simplified form Vl> given in eq. (2.17), 
which corresponds to real Y. From eq. (5.8) we can similarly conclude that, after including 
Zl,r, the minimization of the potential can be explored around the configuration 

Vf m = V v = -2vZ\YZ R , (5.9) 

where Zl,r can also be taken to be real. With this simplification it is not difficult to work 
out the structure of the vevs at the minimum of the potential. Let us start by setting 
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v — > 0. For <72L, 92R > and Y in diagonal form, V m is always positive, and thus it 
is minimized when it vanishes, which occurs when the vevs of Zl jR are misaligned with 
respect to the vev of Y, as for example (Y) = diag (0, 0, 1), (Zi) = vl (cl,sl,0) and 
(Z R ) = v R (cr, sr, 0), with c 2 r+s\ R = 1. Thus, in this limit the minimum of the potential 
is VT^s = 0. However, when u ^ lower (negative) values of V v become possible: for 
small but nonvanishing values of the first two diagonal entries in (Y) the negative sign of V u 
implies the possibility of adding a negative contribution to the minimum of the potential. 
It is true that there is also a price to pay since the minimum of V m will then be lifted to 
positive values, but while this effect in V m is quadratic in the small (Y) entries, it is linear, 
and thus dominant, in V v . We thus expect that V v can favour configurations in which the 
zero entries in (Y) are lifted to non-zero values. 

To see explicitly how this can occur, let us take the new vacua in the form: 

(Y) =vydiag(e,e',y) , with e,e'<y, e 2 + e' 2 + y 2 = l, 

{Z L ) = v L (z L ,e' L ,e L ) with e' L ,e L <^z L , e' L 2 + e| + z\ = 1, 

(Z R ) = v R (z R ,e' R ,e R ) with e' R ,e R <.z R , e' R 2 + e 2 R + z R = 1 . (5.10) 

Vi in eq. (5.3) fixes the 'lengths' vy and vl,r, and vanishes. So we need to consider only 
the effect of 

v t = v A + v D + v m + v v 

= \ A A-2nD + g 2L Z\YY^Z L + g 2R Z R Y^YZ R -2vZ\YZ R , (5.11) 

which vanishes in the limit v — > but remains of 0(e) when v ^ 0. Plugging into V e the 
vevs in eq. (5.10) we obtain: 



\v t = X A v 2 Y [eV 2 + y 2 (e' 2 + e 2 )] -1v Yi i ee'y 



Vy 

2 ( 2 2 , /2 /2 i 2 2\ , 2 / 2 2 , /2 /2 , 2 2\ 

+ 92iv L (z L e +e L e + e L y ) + g 2 RV R (z R e + e R e + e R y ) 

- 2v-^- (z L z R e + e L e' R e + e L e R y) . (5.12) 

The role of V v , which is linear in e in preferring values of e 7^ is apparent, as well as 
the role of Vd in favouring in turn e' 7^ 0. A simple illustrative solution in terms of the 
relevant parameters (i and v can be obtained by setting for simplicity vy = vl = v R and 
\ A = Q2L = 92R and by recalling that the lengths are fixed (i.e. y 2 = 1 — e 2 — e' 2 etc.). 
Solving for the extremal conditions dV e /de = dV e /de' = dV e /dei, R = dV t /de' LR = 0, and 
truncating to terms O (e 2 ) we obtain a unique solution for the global minimum: 

e = o\2 2 2' € ' e L>R = C L,R = °' ( 5 - 13 ) 

3X A v Y - Xa vy 

with V™ m = — Wy e. The relations in eq. (5.13) show that phenomenologically acceptable 
vevs for the up-quark Yukawa couplings could be obtained for example for v ~ fj, ~ 
10 -2 -Aa^V, yielding e' ~ 10 _2 -e ~ 10 -4 . A second possibility, namely v ~ Xavy ~ lO -2 -^ 
yielding e ~ 10 -2 • e' ~ 10~ 4 is in fact not viable since in this case it is not possible to satisfy 
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simultaneously the constraint on fx/m from eq. (2.21) and the condition vy — m/^/2X ~ A 
from the value of the top-quark Yukawa coupling. 

To verify the correctness of the simple minimization procedure that we have outlined 
above, we have also performed a set of numerical minimizations. This has confirmed the 
lifting of the zeroes in (Y) to nonvanishing entries whose values, among other things, are 
controlled in a crucial way by v and fi that, in order to reproduce the observed Yukawa 
hierarchies, should be somewhat suppressed with respect to the other dimensional param- 
eters m, rriL, rriR. Let us stress however, that the numerical analysis that we have carried 
out had just the scope of confirming the structures obtained analytically, and that the 
extremum corresponds to a real global minimum, and did not aim at a thorough explo- 
ration of the full parameter space for finding sets of values satisfying particular naturalness 
requirements. 

One final interesting point is that in all cases we find that two entries in both (^l,_r) 
vanish, see eq. (5.13). The little group of the vevs of the two fundamental representations 
is then Hlr = SU(2)i x SU(2)r. The intersection of Hlr with the little group of the vev 
of the bi-fundamental H Y = U(l)(x 3 ) L+R x U(l)( Xs ) L+R is then H LR n H Y = U(l)^ 3 - )L+R , 
corresponding to the diagonal generator o 3 = \{y[3\% — A3) of SU(2)l+r- This means that, 
out of the 8 + 8 generators of the flavour group, only one remains unbroken, and we can 
then predict fifteen Goldstone bosons. We have studied numerically the spectrum of scalar 
particles, and this confirmed that the symmetry breaking pattern induced by scalars in the 
reducible representation (3, 1) (1, 3) (3, 3) is indeed SU(3) L x SU(3) R -> U(1) ((7s)l+r . 

6 Conclusions 

The possibility that the highly non-symmetric spectra of the fermions with the same SM 
quantum numbers could arise from the specific structure of the vacuum of an otherwise 
flavour-symmetric theory, is theoretically very attractive. In this paper, we have studied 
which premises are needed to render this idea phenomenologically viable. 

In ref. [12] it was found, as a promising starting point, that an SU(3) l x SU (3)r invari- 
ant tree-level potential for Yukawa fields Y transforming as the irreducible bi-fundamental 
(3,3) representation of the flavour group admits vacuum structures (Y) oc diag(0, 0, 1). It 
was then natural to ask if the vanishing entries could be lifted to suppressed but nonva- 
nishing values by some type of small perturbation. This would correspond to a stepwise 
breaking of the flavour symmetry. 

In this paper we have argued that the structure of the tree-level vacua is perturbatively 
stable. Regarding the possibility of a stepwise symmetry breaking due to loop corrections, 
it was already discussed long ago [19, 20] that this can only occur in the presence of 
additional (non NGB) scalars that are massless at tree level. By direct computation of the 
effective potential (see the Appendix) we have confirmed that the little groups of the vacua 
of the tree-level potential are also the little groups of the vacua of the one-loop corrected 
effective potential, and that this remains true even in the presence of additional scalars 
that are unnaturally massless (that is, massless due to fine tuning of some parameters). 
We have also argued that this result can be straightforwardly extended to the possible 
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effects of operators of higher dimension. In Section 4 we have further confirmed this and 
argued that, except for some special cases, a generic SU(3)l x SU(3)r invariant function 
of a single scalar field Y transforming in the bi-fundamental representation of the group, 
admits vacuum structures (Y) with at least two equal eigenvalues, and thus it cannot yield 
a fully hierarchical pattern. 

We have thus learned that a phenomenologically viable Yukawa structure (Y) oc 
diag(e, e',1) must arise already at the tree level, and that in order to achieve this, the 
breaking must occur via reducible representations. After enlarging the scalar sector by 
adding two multiplets Zl and Zr transforming respectively in the fundamental represen- 
tation of the SU(3)l,r factors of the flavour group, we have constructed the most general 
fourth-order potential involving Zl,r and Y, and we have shown that minima yielding the 
hierarchical structure (Y) oc diag(e, e', 1) can indeed appear. The Yukawa hierarchy for the 
up-type quarks can then be qualitatively reproduced at the cost of a relatively mild hier- 
archy between the dimensional parameters of the scalar potential, not exceeding ~ 1CP 2 . 
The hierarchies in the down-quark and charged lepton sectors are also reproducible with 
even milder hierarchies in the fundamental parameters. 

In a more complete scenario we would first need to extend the symmetry to the full 
quark flavour group SU(3)q l x SU(3) Ur x SU(3)d R , and then couple through appropriate 
renormalizable invariant terms the Yukawa fields of the up and down-quark sectors Y q , Z q 
(q = u, d) and Z® (see ref. [12] for a first attempt with only irreducible representations 
Y q ). Besides reproducing the mass hierarchies, such a scenario should also reproduce the 
hierarchies in the CKM mixing angles, and yield a nonvanishing value for the CP violating 
Jarlskog invariant [27]. We believe that, in spite of its complexity, such a program can 
be carried out successfully, and we expect to publish soon some results that go in this 
direction [28]. 

Eventually, one should also worry about the testability of this type of construction. 
It is clear that the scalar potential of a more complete model will contain a number of 
fundamental parameters much larger than the number of observables (the six quark masses, 
the three mixing angles, and the CP violating phase 5) implying that it is unlikely that 
predictive relations among different observables could arise. Direct evidences might arise 
from the fact that if the flavour symmetry is global, then SSB implies the presence of 
Nambu-Goldstone bosons that could show up in yet unseen hadron decays or in rare flavour 
violating processes [29]. If the flavour symmetry is instead gauged [9, 10], then to ensure 
the absence of gauge anomalies additional fermions must be introduced [10], and their 
detection could represent a smoking gun for this type of models. All this remains, however, 
a bit speculative, especially because the theory provides no hint of the scale at which the 
flavour symmetry gets broken, and very large scales would suppress most, if not all, types of 
signatures. In spite of these considerations, being able to reproduce the observed pattern 
of Yukawa couplings from the SSB of the flavour symmetry would certainly represent 
an important theoretical achievement, and we believe that the results discussed here can 
provide some relevant steps in this direction. 
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A Effective potential for a single irreducible representation 



The SU(3)l x SU(3)r invariant one-loop Coleman- Weinberg (CW) [21, 30] effective po- 
tential for a scalar field Y in the bi-fundamental representation (3, 3) can be written, in 
the MS scheme, as: 



V = Vq + V 1 



with 



m 
2A 



V = X T(Y) 

-\ YmHy) 

64tt 2 4^ 



+ \ A A(Y) + (iD(Y) + fi*V*{Y) 



Vl 



log 



A 2 



(A.l) 

(A.2) 
(A.3) 



where all the parameters in Vq are renormalized at the scale A: A = A(A), m? = m 2 (A), etc. 
The field dependent mass functions M 2 (Y) in eq. (A.3) are the eigenvalues of the matrix 



[M 2 ] ijM 



d 2 v 
dyijdy kl 



(A.4) 



where y^ = {Rij, Jij} with Rij (Jij) = y/2 Re(Im)iij and, without loss of generality, 
we can take the background constant field Y in the diagonal form eq. (2.16). Here we 
are including only the contributions to the effective potential that come from scalar self- 
interactions between the components of the Y field. In concrete models Y will interact with 
other sectors of the theory, which will then also contribute to the loop corrected potential. 
From eq. (A.4) one can compute straightforwardly the two traces 



TrM 2 = 8 (5A + X A ) T - 18m 2 , 
TrM 4 = AT 2 [(5A + A^) 2 + (A - A A ) 2 ] 



8T 



2m 2 (5A + \ A ) - 



-AS\\ a A + 24 (A + X A ) (hV + n*V*) + 18m 4 



(A.5) 



(A.6) 



which give the field dependent divergent part of the CW potential, which (using a cutoff 
regularization) reads: 



SaV 



The logarithmic part can be used to obtain the beta functions of A, X A , m 2 and fi (up to 
contributions from other sectors of the theory). 

Computing the finite contribution to the CW potential eq. (A.3) is instead a difficult 
problem, since it requires diagonalizing the full 18 x 18 matrix eq. (A.4), namely solving 
the eigenvalue equation 



det(M 2 -I-M x 



0. 



(Ai 



where M 2 are the eigenvalues, / 
Y = (Y) = diag(VH, VT2,VE)- 



'18x18 



and Ai 2 is given in eq. (A.4) evaluated at 
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The problem is somewhat simplified by the fact that the eigenvalues will come in 
multiplets of the unbroken little group, and another simplification is obtained by looking 
for a minimum around the configuration eq. (2.18), that is (Y) = diag(y / £i, y^, v^)- 9 
We have managed to solve the problem by means of a 'brute force' procedure, that can be 
resumed in the following steps: 

(i) The determinant in eq. (A. 8) admits a factorization of the form 

det(M 2 • I - M 2 ) = P (6) (M 2 ) x nf =1 n±(M 2 - M 2 ±) 2 , (A.9) 

where P( 6 )(M 2 ) is a sixth-order polynomial in M 2 . This factorization allows to identify 
the first twelve eigenvalues (labeled with i± with i = 1,2,3) that come arranged into six 
degenerate doublets, and are: 

Ml =m 2 + l -\ A & ± y/F fo,T,A,D), (A.10) 



where 



F(£ h T,A,D) 



m 2 = -m 2 + 2XT, (A. 11) 

' * ' ' ' ' Zi + \ A (\ A A + 2nD). (A.12) 



A.r(|-r)+// 2 



The eigenvalues £j of the matrix of constant classical fields YY\ and can be explicitly 
written in terms of the invariants T, A, D by solving the cubic equation: 

det(£/ 3 x 3 - YY*) =e~ Ti 2 + AC - D 2 = 0. (A.13) 

(ii) Concerning the roots of p( 6 )(M 2 ) in eq. (A.9), it is well known that there is no 
formula in radicals to solve polynomial equations beyond quartic [31]. However, on physics 
grounds we know that p( 6 )(M 2 ) = must be solvable with real and positive solutions. We 
have then approached the problem of extracting the solutions by studying various limits 
with increasing steps of complexity: X A , /J, = (A ^ 0); A, [i = (A^ / 0); \i = and 
A, X A ^ 0; A a = and A, fj, ^ 0. This allowed us to identify some characteristic structures 
appearing in the solutions. 

(iii) Finally, given that P^{M 2 ) = is solvable, it follows that the sixth order poly- 
nomial must be factorizable in several different ways into lower order polynomials like 
p(3) . p(3) or p(2) . p(2) . p(2) Qr p(2) . p(4) ) a \\ mus t have real and positive solu- 
tions. This implies that the structure of the solutions can be recast in the general form of 



9 This is justified by the fact that after reabsorbing the phase of jl in T>, any imaginary part of the 
determinant, corresponding in our basis to J33 7^ 0, would imply deviation from cos<f>x> = — 1 and would 
shift the value of Vd eq. (2.15) away from its minimum. In the loop corrections, functions involving terms 
like T> n + T>*" ~ D n cos(n 4>t>) also appear. For even n they are extremized at (j>T> = n/n and could 
thus shift, at least in principle, the minimum from it to the doubly degenerated point 4>t> = 7r ± a (with 
suitable values of a), yielding a complex (T>) and spontaneous breaking of CP. However, the loop coefficient 
suppressing these contributions is small enough to guarantee stability of the minimum in tt and that the 
background value of the determinant does not acquire an imaginary part. This is of course in agreement 
with ref. [20] where the necessary conditions for stepwise breaking of discrete symmetries were stated. 
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solutions of quadratic, cubic and quartic polynomial equations. When written down as the 
roots of two cubic polynomials the remaining six eigenvalues read (with i, i' = {1, 2, 3}): 

M f =rn 2 + 2 -\ A T+ r -i-P l /3+ 1 Zp 



3 3riPV3 ' 

where r^j' are the three roots of x 3 + 1 = 0, that is, { — 1, e _J7r//3 , e ln ^ 3 }, while 
Z P = X 2 A (T 2 - 3A) + 3n 2 T, 

Z Q = Z P + 16A 2 T 2 + 4Aa [2A (9 A - T 2 ) + 3X A A] + 36 (2A + X A ) pD, (A.15) 

and 



P = -^JX 2 p - AZ% - 9X Al x 2 T 2 - -\\AT + AiT 3 
+y [2^D + 2A A/ u 2 ^ + \\D 2 ] , 

Q = - 4Z 3 + 9 (4A - X A ) p 2 T 2 - (4A - A^) 3 T 3 

~ [32X 2 fiD + 32AA A {XA + pD) - X A (4AA - S/iD + X A A)] T 

-y [2p 3 D + 16Xp 2 A + 2Xa^ 2 A + 27A^ (4A + A a) £> 2 ] , (A.16) 



with 



X P = 54p 3 D - 18X A p 2 (T 2 - 3A) + X 3 A (2T 3 - 9AT + 27£> 2 ) , 
X Q = 2 [64A 3 T 3 - 36A/i 2 T 2 + A32X 2 pDT + 27/i 2 (8XA + pD)) 

+6Aa [-16A 2 T 3 + 3^ 2 T 2 + UiXfiDT + 9A (16A 2 T + p 2 )] 

+3X 2 A (-3QXAT + 8 AT 3 + 972AD 2 + 72fiDT) 

-X\ (27 AT + 2T 3 - 729 D 2 ) . (A.17) 

By solving the eigenvalue problem numerically, and confronting the solutions with the 
corresponding numerical values of the analytic expressions for M 2 , we have verified the 
correctness of the analytic formulas given in eqs. (A.10)-(A.14). 

This explicit expression for the potential can then be used to explore the change of 
the tree- level vacuum induced by the radiative corrections. An alternative approach (see 
e.g. [32]) that does not require solving for the exact mass eigenvalues that enter the CW 
potential is to calculate the field derivatives of the potential (or derivatives with respect 
to the invariants T, A, D) needed in the minimization equations using perturbation theory 
around the tree-level vacuum, obtaining the derivatives of the masses directly from the 
derivatives of the characteristic polynomial det(M 2 • / — M 2 ) = (which can be written in 
terms of the T,A,D invariants, although we do not write those expressions explicitly). We 
have also verified in this manner that the one-loop corrections shift the tree-level minimum 
rotating it in field space, but without changing its minimum structure, which still yields a 
Yukawa coupling matrix of the form (Y) oc diag(0, 0, 1). 
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